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DETAILED ACTION 



Response to Amendment 



1. The amendments to the specification overcome the Examiner's objections cited in 
paragraph 6 of the previous office action. 



2. AppHcant's arguments filed January 29, 2004 have been fiilly considered but they are not 
persuasive. 

The Applicant alleges that one of ordinary skill in the art would not combine FuUam et al 
with Olsson, as FuUam et al "uses a fixed focus lens and thus the depth of field cannot change 
with Olsson which utilizes depths of field to create a focused image" on page 7, lines 6-11. The 
Examiner respectfully disagrees. The Examiner does acknowledge that the system of Olsson 
changes the camera settings in order to take images at various depths of focus. However, FuUam 
et al teach two distinct methods of maintaining an object in focus in column 1, lines 51-62. The 
first method, similar to the method of Olsson, is an auto focus, which changes the optical camera 
settings between the individual recordings in order to automatically focus the camera. The 
second method does not change the optical camera settings, but rather maintains a predetermined 
distance between the object and the camera. FuUam et al explain in column 1, lines 13-25 that 
by maintaining the predetermined focal distance, the object will remain in focus. These two 
methods are different means of achieving the same result, namely, an object being in focus and 
are therefore, art-recognized equivalents at the time of the invention. The second method of 
adjusting the spatial location explained by FuUam et al would be beneficial in the system of 
Olsson because the magnification of the object would not change in successive recordings if a 
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predetermined distance between the object and the camera is maintained and the optical camera 
settings are not adjusted. Thus, the processing required in order to correctly "stitch" the 
individual objects together would be reduced. One of ordinary skill in the art at the time the 
invention was made would not combine the systems of Olsson and FuUam et al, but would rather 
substitute the method of recording an object in focus in the system of Olsson from the first 
suggested method to the second suggested method of FuUam et. Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to adjust the spatial 
setting of a camera rather than adjusting the optical camera settings in order to record an image 
of an object in focus because both methods are art-recognized equivalents and the processing 
required to "stitch" the images together would be reduced. 

The Applicant alleges that Duvent teaches away from a method where the camera 
settings are not adjusted because Duvent discloses a system for automatically focusing a video 
pickup device. The Examiner respectfully disagrees. Duvent explains determining the sharply 
imaged area by taking the derivative of the input image as explained in column 3, line 30 to 
column 4, line 5. Using the derivative to determine the in- focus regions (or sharply imaged 
areas) of digital images provides an efficient means of performing the in- focus region detection 
in the system of Olsson and FuUam et al. The method of capturing the images without changing 
the optical camera settings are explained with reference to the system of Olsson and Fullam et al. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to use derivative to determine the sharply imaged areas of an image. 

The Applicant alleges that Hart teaches away from a system where the camera settings 
are not adjusted because Hart automatically focuses the camera. The Examiner respectfiiUy 
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disagrees. Hart discloses using a computer to control the sequence of recording in column 9, line 
48 to column 10, line 9. By controlling the camera automatically using the range as a parameter, 
film or storage space and energy will be conserved, which is very important in portable or 
remote cameras. The method of capturing the images without changing the optical camera 
settings are explained with reference to the system of Olsson and FuUam et al Therefore, it 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
have a computer control the recording of a camera depending of parameters of recording. 

In response to applicant's arguments against the references individually, one cannot show 
nonobviousness by attacking references individually where the rejections are based on 
combinations of references. See In re Keller, 642 F.2d 413, 208 USPQ 871 (CCPA 1981); In re 
Merck & Co,, 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

Drawings 

3. The drawings were received on 1/29/2004. These drawings are accepted. 

Claim Objections 

4. The following quotations of 37 CFR § 1.75(a) and (d)(1) are the basis of objection: 

(a) The specification must conclude with a claim particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention or discovery. 

5. Claim 1 is objected to under 37 CFR § 1.75 as failing to particularly point out and 
distinctly claim the subject matter which the applicant regards as his invention or discovery. The 
claim language in line 4, "camera settings" is vague. While the examiner understands the 
camera setting to be the "setting used for the optical components" on page 3, lines 3-5 of the 
disclosure, the claim language still broadly encompasses spatial settings of the camera as well as 
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the optical settings. The following language (or equivalent) is suggested: "optical component 
settings of the camera". 

Claim Rejections - 35 USC§103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1-2, 8-12, and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Olsson (WO 97/25690) in view of FuUam et al (U.S. Patent No. 5,666,569). 

Referring to claim 1 , 

i. Making a plurality of individual recordings of the object with a single camera at 
various spatial settings with respect to the relative position between the object and the 
camera without adjusting camera settings between the individual recordings in not 
explicitly explained by Olsson. Olsson does explain shooting multiple images of an 
object with a single camera at different camera settings on page 3, paragraph 2. 
However, FuUam et al teach two distinct methods of maintaining an object in focus in 
column 1, lines 51-62. The first method, similar to the method of Olsson, is an auto 
focus, which changes the optical camera settings between the individual recordings in 
order to automatically focus the camera. The second method does not change the optical 
camera settings, but rather maintains a predetermined distance between the object and the 
camera. FuUam et al explain in column 1, lines 13-25 that by maintaining the 
predetermined focal distance, the object will remain in focus. These two methods are 
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different means of achieving the same result, namely, an object being in focus and are 
therefore, art-recognized equivalents at the time of the invention. The second method of 
adjusting the spatial location explained by FuUam et al would be beneficial in the system 
of Olsson because the magnification of the object would not change in successive 
recordings if a predetermined distance between the object and the camera is maintained 
and the optical camera settings are not adjusted. Thus, the processing required in order to 
correctly "stitch" the individual objects together would be reduced. One of ordinary skill 
in the art at the time the invention was made would not combine the systems of Olsson 
and Fullam et al, but would rather substitute the method of recording an object in focus in 
the system of Olsson from the first suggested method to the second suggested method of 
Fullam et. Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to adjust the spatial setting of a camera rather than adjusting 
the optical camera settings in order to record an image of an object in focus because both 
methods are art-recognized equivalents and the processing required to "stitch" the images 
together would be reduced. 

ii. Determining the sharply imaged areas of the individuals is explained by Olsson 
on page 3, paragraphs 4-6. Olsson explains that the focused image element is selected 
from each of the captured images. 

iii. Assembling the sharply imaged areas of all the individual recordings to form at 
least one resulting image is explained by Olsson on page 3, paragraph 3. Olsson explains 
that a sharp image is created by adding together focused different image elements. 
Referring to claim 2, 
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i. Storing the individual recordings in a computer is explained by Olsson on page 9, 
paragraph 3. 

ii. The sharply imaged areas of the individual recording being determined by the 
computer with the aid of digital methods is explained by Olsson on page 9, paragraph 5. 
Olsson explains that programs can be added to the computer to select elements from 
different images, which are the basis of subsequent corrections. 

iii. The resulting images being assembled with the aid of a computer is explained by 
Olsson on page 9, paragraph 5. Olsen explains that programs can be added to the 
computer for matching the basic image format for integration of focused image elements. 
Referring to claim 8, the individual recordings being made at fixed, predetermined 

relative distances between the camera and the object is not explicitly explained by Olsson. 
However, Fullam et al explain that a user has to position a single lens camera a certain distance 
from a target in order to achieve proper focal length to capture a sharp image of the target in 
column 1, lines 59-62. If the object were to move, then the user would reposition the camera in 
order to maintain the proper focal length as the single lens camera cannot be adjusted. 
Maintaining a fixed, predetermined distance between a target and the camera would have been 
obvious to one of ordinary skill in the art at the time the invention was made in order to preserve 
the proper focal length of a non-adjustable camera when the target moves. 

Referring to claim 9, a CCD camera being used as the camera for recording the sequence 
of individual recordings is not explicitly explained by Olsson. However, Fullam et al explain 
using a CCD to capture images in column 2, lines 2-12. Using a CCD camera would improve 
the system of Olsson by saving the time and computation required to convert analog images to 
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digital images. It would also allow the system of Olsson to work in real time. Therefore, it 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
use a CCD camera for recording a sequence of images. 
Referring to claim 10, 

i. Storing all the individual recordings of the sequence in a computer is explained by 
Olsson on page 9, paragraph 3. Olsson explains that the software on the computer can 
store several images, which together would constitute a sequence. 

ii. Determining the sharply imaged areas after recording of the individual recordings 
has been concluded is explained by Olsson on page 9, paragraph 5. The computer 
programs can process the images to be able to select elements after the images have been 
stored on the computer. 

Referring to claim 11, the sharply imaged areas of each individual recordings being 
identified and incorporated into the resulting image immediately after the individual recordings 
have been made is explained by Olsson on page 9, paragraph 5. The computer programs 
processes each image stored on the computer individually, either after all the images are stored 
or after the sequence of images is collected. Such processing is available because Olsson does 
not require information from an entire sequence of images to determine the in- focus region of a 
single image. 

Referring to claim 12, a plurality of resulting images being assembled from the individual 
recordings, different areas of the object or different features of the object being shown in the 
resulting images would be inherent in the system of Olsson. The system of Olsson is capable of 
assembling a plurality of images to produce a resulting image. Using different portions from the 
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sequence of images, multiple resulting images can be produced that would each include different 
features of the object being imaged. 

Referring to claim 20, a computer, a camera, and a control device being provided is 
explained by Olsson on page 9, paragraph 2. Olsson explains that a camera is connected to a 
computer for obtaining images of an object. Olsson further explains that the camera consists of 
controls, v^hose settings can be registered. 

8. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over Olsson in viev^ of 
FuUam et al, and further in view of Duvent (U.S. Patent No. 4,701,782), 

Referring to claim 3, the sharply images areas being determined by digital formation of 
the derivative is not explicitly explained by Olsson or FuUam et al. However, Duvent does 
explain determining the focus of a camera by taking the derivative of the input image in the 
abstract and in column 3, Hne 30 to colunm 4, line 5. Duvent explains that the quality parameter 
determines whether the image is appropriately in focus. When an image is in focus, the contours 
of the image are very sharp and therefore, the contours would have high derivative values. It 
would be obvious to insert the digital derivative computing method of Duvent into the sharp 
image determining section of Olsson and FuUam et al, as their images are also stored digitally 
and the derivative can be determined efficiently to reduce the processing required in the system 
of Olsson and FuUam et al. Therefore, it would have been obvious to one of ordinary skill in the 
art at the time the invention was made to use derivative to determine the sharply imaged areas of 
an image. 

9. Claims 4-6 are rejected under 35 U.S.C, 103(a) as being unpatentable over Olsson in 
view of FuUam et al, and further in view of Hart (U.S. Patent No. 5,473,368). 
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Referring to claim 4, the parameters for recording a sequence of individual recordings 
being predetermined by a computer and the computer controUing the sequence of the recording is 
not explicitly explained by Olsson or FuUam et al. However, Hart explains a microprocessor 
controlling the parameters of recording in the abstract and in colimm 9, line 48 to column 10, 
Kne 9. The parameter of recording is the output of the ultrasonic rangefinder, which detects if an 
intruder as entered an area. The microprocessor then controls the camera to record a scene if an 
intruder is detected to be in an area and the microprocessor then shuts down the surveillance 
device if the intruder leaves an area. By controlling the camera automatically using the range as 
a parameter, film or storage space and energy will be conserved, which is very important in 
portable or remote cameras. Therefore, it would have been obvious to one of ordinary skill in 
the art at the time the invention was made to have a computer control the recording of a camera 
depending of parameters of recording. 

Referring to claim 5, the recording of the sequence of individual recordings being started 
automatically corresponds to claim 4. The camera starts recording automatically when an object 
is detected in the rangefinder area. 

Referring to claim 6, the recording of the sequence of individual recordings being started 
by means of a photoelectric barrier corresponds to claim 4. The applicant explains the 
photoelectric barrier as detecting whether an object is moving towards or away from the camera. 
Therefore, the photoelectric barrier corresponds to the rangefinder of Hart. 
10. Claims 7, 14-15, 17, and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Olsson in view of FuUam et al, and further in view of well known prior art. 



Application/Control Number: 09/508,847 Page 1 1 

Art Unit: 2621 

Referring to claim 7, the individual recordings being made at fixed, predetermined time 
intervals is not explicitly explained by Olsson or Fullam et al. However, a camera recording 
frames at fixed, predetermined time intervals is well known in the art (official notice). Every 
camera is capable of taking a predetermined number of images per second in order to capture a 
seemingly continuous event. In order to reduce the memory required to record an event, 
surveillance cameras typically use a lower fi-ame rate, which resulting in poor film quality and 
discontinuity. Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to recording images at a fixed, predetermined time interval. 

Referring to claim 14, the at least one resulting image being used to identifying a feature 
of the finger is not explicitly explained by Olsson or Fullam et al. However, imaging a finger to 
identify features of a finger is well known in the art (official notice). Features of a finger serve 
to identify the person whose finger has been imaged. The system of Olsson and Fullam et al 
would be capable of imaging a finger to obtain a completely in- focus image of the finger. 
Therefore, it would have been obvious to, one of ordinary skill in the art at the time the invention 
was made to image a finger to identify features of the finger. 

Referring to claim 15, the object being illuminated by a light source is not explicitly 
explained by Olsson or Fullam et al. However, using a light to illuminate an object being 
imaged in order to capture an image in the dark or obtain a higher quality image is well known in 
the art (official notice). Such an illumination source would allow the camera of Olsson and 
Fullam et al to be effective in the dark. Therefore, it would have been obvious to one of ordinary 
skill in the art at the time the invention was made to illuminate an object with an illumination 
source. 
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Referring to claim 17, the object being illuminated by a plurality of light sources of 
different wavelength ranges and in different arrangements is not explicitly explained by Olsson 
or FuUam et al. However, using a plurality of different light sources at different wavelengths is 
well known in the art (official notice). Using different wavelengths of light allows for increased 
contrast in an image, which would improve object identification. Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to illuminate an 
object with multiple light sources of different wavelengths. 

Referring to claim 19, only areas of the object that are within the focus of the camera 
being illuminated is not explicitly explained by Olsson or FuUam et al. However, illuminating 
an object that is within the focus of the camera is well known in the art (official notice). 
Illuminating an area of an object increases the quality of that portion of the image and allows for 
capturing an image in the dark. Emphasizing different portions of an object would be beneficial 
in the imaging system of Olsson and FuUam et al as the in focus areas can be imaged in higher 
quality, so that the resulting composite image would be of higher quality. Furthermore, the 
imaging system of Olsson and Fullam et al discards the out of focus areas of the image, so 
illuminating the entire scene would not improve the resulting composite image. Therefore, it 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
illuminate only areas of an object that are within the focus of the camera. 

11. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Olsson in view of 
Fullam et al, and further in view of Sieben (U.S. Patent No. 5,445,155). 

Referring to claim 13, dividing an image plane into a plurality of areas and processing the 
image areas in parallel are not expHcitly explained by Olsson or Fullam et al. However, Sieben 
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explains dividing an image into plurality of areas to process the areas in parallel in column 45, 
lines 45-58. In order to increase the speed of the processing of images to display the images 
real-time, it is necessary to process the images with a powerful microprocessor or in parallel. 
Because the each section of the images of Olsson and Fullam et al are being determined to be 
sharp or not sharp, it would be obvious to send each section to an individual processor as 
explained by Sieben to increase processing speed at a low economical cost. Thus, multiple 
images, in 2D or 3D, can be computed very quickly. Therefore, it would have been obvious to 
one of ordinary skill in the art at the time the invention was made to divide the image plane into a 
plurality of areas and process the images in parallel. 

12. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Olsson in view of 
Fullam et al and Hart, and further in view of well known prior art. 

Referring to claim 16, a pulsed light source that is synchronized with the camera being 
used is not explicitly explained by Olsson or Fullam et al or Hart. However, a pulsed light 
source being synchronized with the camera is well known in the art (official notice). The object 
of an illumination source is to illuminate an object for imaging in low Ught conditions. If a 
pulsed light source were not synchronized with the camera, then the object to be imaged would 
not be illuminated as it is being imaged, thereby defeating the benefit of the illumination source. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to synchronize a pulsed light source with the camera being used. 

13. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Olsson in view of 
Fullam et al and well knovra prior art, and further in view of Hart. 
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Referring to claim 18, the object being illuminated as long as it is moving towards the 
camera and away from the camera corresponds to claim 4. The microprocessor will operate the 
surveillance device as long as the output of the range finder detects an object is moving in an 
area. Hart explains in column 9, lines 54-62 that the surveillance device includes a light. 
Therefore, when the surveillance device is on, the light will illuminate the object being imaged. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to illuminate an object as long as it moves toward and away from the camera, so that 
the object can be imaged accurately in low hght conditions. 

Conclusion 

14. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the maiUng date of this action, hi the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

15. Any inquiry concerning this conmiunication or earlier communications from the 
examiner should be directed to Hussein Akhavannik whose telephone number is (703)306-4049. 
The examiner can normally be reached on M-F 8:30-5:00. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo H. Boudreau can be reached on (703)305-4706. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for impublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Hussein Akhavannik 
March 10, 2004 





// ' leo boudreau 
Supervisory patent examiner 
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